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The  momentary  ^rkload  that  Is  imposed  by  a cognitive  task  tq)on  the  limited 
capacity  human  information-processing  system  appears  to  be  accurately  reflected  in 
the  momentary  level  of  central  nervous  system  activation.  The  utility  of  pupillometric 
methods  of  workload  assessment  is  evaluated  and  several  lines  of  experimental  evi- 
dence relating  activation  and  cognitive  function  are  reviewed. 


INTRODUCTION 


^formation  processing  tasks  differ  in  the  extent  and  duration  of  the  demands 
that  they  place  upon  the  limited  capacity  of  the  human  nervous  system  to  handle  infor- 
mation. For  most  tasks,  processing  demands  are  not  constant,  but  vary  from  moment 
to  moment  in  response  to  changes  in  the  functional  organization  of  the  task.  These  de- 
mands may  be  thought  to  represent  the  cognitive  workload  associated  with  the  task,  a 
tlme-varyln|;  function  of  the  demand  for  limited  resources. 

Given  the  assumption  that  cognitive  capacity  is  fixed  (reference  1),  the  momen- 
tary demands  any  single  processing  function  for  capacity  may  be  estimated  by  de- 
termining the  amount  of  residual  capacity  that  may  be  allocated  to  another  processing 
task  that  is  assigned  a secondary  inriority  (reference  2).  Secondary-task  measurement 
of  cognitive  workload  is  of  major  iixq)ortanee  in  the  study  of  both  cognitive  capacity 
and  the  resource  demands  of  particular  processes,  but  both  technical  (reference  2)  and 
theoretical  (reference  3)  difficulties  preclude  the  utilisation  of  secondary-task  proce- 
dures in  many  sltuattons.  For  this  reason  the  more  convenient  method  of  subjective 
estimaticn  of  cognitive  workload  is  still  commonly  enq>lcyed  (reference  4)  despite 
serious  quesffons  as  to  both  the  reliability  and  validity  of  such  rating  procedures. 

A tUrd  Miproacdi  to  the  problem  of  meaaurlng  momentary  ot^tive  workload 
stems  from  the  observation  that  mcmeidary  workload  is  directly  reflected  in  the  mo- 
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mentary  level  of  central  nervous  system  (CNS)  activation  (references  5 and  6).  Of  the 
various  Indicators  of  actlvatlcoi,  pupillometrlc  measurement  techniques  (references 
7,  8 and  9)  appear  to  be  most  sensitive  and  reliable  (reference  10). 

The  present  paper  examines  several  lines  of  evidence  suggesting  that  pupillome- 
tric  measures  of  activation  serve  as  a reliable  indicator  of  cognitive  workload  in  per- 
ception, memory,  decision  and  complex  problem  solving.  An  extension  of  this  experi- 
mental method  to  the  study  of  problems  of  workload  optimization  in  complex  man/ma- 
chine systems  is  then  considered. 


PERCEPTUAL  PROCESSES 


Perceptual  processes  appear  to  proceed  quite  effortlessly  and  place  rather  little 
demand  iqxm  the  limited  capacity  of  the  human  information-processing  system  (5). 
Thus  Wlckens  (reference  11)  was  unable  to  observe  a secondary  task  decrement  when 
a sensory  signal-detection  task  was  imposed  as  the  primary  task  in  an  e>qperiment  in- 
vestigating the  distribution  of  processing  capacity.  The  workload  involved  in  the  detec- 
tion of  weak  signals  is  quite  small. 

In  this  context,  it  le  of  interest  to  note  that  small  but  reliable  piq)illary  dilations 
accompany  the  detection  of  both  visual  and  acoustic  signals  at  near-threshold  intensi- 
ties. Kakerem  and  Sutton  (reference  12)  examined  the  pupillary  movements  that  ac- 
company the  perception  of  weak  visual  stimuli  and  were  able  to  show  a dilation  for 
signals  that  were  detected  which  was  absent  for  signals  that  were  missed.  More  re- 
cently Beatty  and  Wagoner  (reference  13)  provided  a pupillometrlc  analysis  of  activa- 
tion in  the  detection  of  weak  acoustic  signals  using  a rating-scale  respcmse  procedure 
(see  reference  14).  Using  unmarked  observation  intervals,  no  pupillary  dilations  were 
observed  in  the  absence  of  a signal  regardless  oi  the  outcome  ^ the  observer's  deci- 
sion. In  the  presence  of  a signal,  a dilation  of  the  pupil  appeared  in  the  interval  be- 
tween signal  delivery  and  response  cue  onset.  The  magnitude  of  this  dilatimi  varied 
monotonically  with  the  observer's  rated  probability  that  a signal  had  been  presented. 

These  data  raise  the  Interesting  possibility  that  pupillometrlc  methods  may  pro- 
vide a more  sensitive  measure  of  cognitive  load  than  do  conventional  secondary-task 
measurement  techniques.  Thus  the  small  papillary  dilations  observed  during  percep- 
tual processing  may  be  indexing  brain  workload  levels  that  are  not  of  sufficient  mag- 
nitude to  be  detected  by  secondary  task  interference  methods. 
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DECISION  PROCESSES 


Even  simple  decision  processes  appear  to  impose  some  workload  on  the  cogni- 
tive system  as  indicated  by  pupiUometric  measures  of  activation.  For  example, 
Simpson  and  Hale  (reference  IS)  measured  pupillary  diameter  in  two  groups  of  sub- 
jects who  were  required  to  move  a lever  to  one  of  four  positions,  hi  the  decision 
i(roiq>t  subjects  were  told  at  the  beginning  of  each  trial  that  either  of  two  directions 
was  permissible  (e.g. , front  or  left).  Seven  seconds  later  a response  cue  was  pre- 
sented and  the  subject  initiated  one  of  the  two  movements,  hn  the  no-decision  control 
group,  subjects  were  instructed  exactly  as  to  the  desired  movement  on  each  trial 
(e.g. , front).  Pupillary  dilation  in  the  post-instruction  pre-response  period  was  lar- 
ger and  more  prolonged  for  those  subjects  who  had  to  choose  between  two  movements 
before  responding. 

Substantially  larger  piqilllary  dilations  are  observed  to  accompany  more  diffi- 
cult decision  prooesses.  hi  an  experiment  reported  by  Kahneman  and  Beatty  (refer- 
ence 16),  listeners  were  required  to  determine  vdiether  a comparison  tone  was  of 
higher  or  lower  pitch  than  the  standard.  Clear  piqiillary  dilation  occurred  in  the  4- 
seoond  decision  period,  between  presentatlcm  of  the  comparison  tone  and  the  response 
cue.  The  amplitude  of  this  dilation  varied  as  a direct  function  of  decision  difficulty, 
the  difference  in  frequency  between  the  standard  (850  Hz)  and  comparison  tones. 

This  relation  is  shown  in  figure  1,  which  presents  both  the  amplitude  of  dilation  in 
the  decision  period  and  the  percent  decision  errors  as  a function  of  the  frequency  of 
the  comparison  tone.  These  dilations  were  highly  reliable  and  did  not  habituate  over 
the  experimental  session.  Piqpillary  dilations  during  decision  appear  to  vary  as  a 
function  of  cognitive  workload,  as  Inferred  from  task  parameters  and  performance 
data. 


MEMORY  PROCESSES 


The  idea  that  human  Informatlon-prooesBlag  oapaolty  is  limited  arose  directly 
from  ffM  study  of  ths  limitations  of  hman  short-term  or  worklag  memory  (reference 
17).  Our  capacity  for  unrelated  items  Is  on  ths  order  of  seven  or  eight,  with  some 
adjnstmsBt  beiaf  mads  for  ths  dffBoiilty  of  the  to-be-remembered  units.  If  pqpillary 
movsmsBts  reflect  CNB  activation  shifti  as  a fimctlon  of  oognitive  workload,  than 
thsse  relatlans  should  bs  clearly  revealed  in  the  pupiUometric  investigation  of  mem- 
ory processes. 

Kahneman  and  Beatty  (refarsBce  18)  provided  a demonstration  that  ths  momen- 
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taiy  load  placed  iq>on  the  cognitive  eyetem  by  a memory  task  is  reflected  in  piq>illary 
diameter,  hi  a series  of  experiments  on  short-term  serial  memory  using  paced  re- 
call. students  were  required  to  listen  to  strings  of  from  one  to  seven  items  and,  after 
a 2 second  pause,  repeat  the  string  at  the  rate  of  one  item  per  second.  For  strings  of 
digits,  piqiiUary  diameter  increased  as  each  item  of  the  input  string  was  heard  and 
decreased  as  each  item  of  the  output  string  was  spoken.  Thus  pupillary  diameter  at 
the  pause  between  input  and  output  varied  as  a monotonlc  function  of  the  number  of 
items  held  in  memory.  These  pupillary  functions  are  shown  in  figure  2A. 

Workload  in  a memory  task  depends  not  only  iq>on  the  number  of  items  to  be  re- 
membered, but  also  upon  tlM  difficulty  of  each  of  the  items  themselves.  Thus,  as 
fewer  unrelated  words  may  be  reliably  recalled  thaw  unrelated  digits,  the  load  im- 
posed by  each  'vord  vpaa  the  cognitive  system  Is  presumed  to  be  greater.  Figure  2B 
preeents  the  results  of  a serial  memory  experiment  involving  strings  of  four  digits 
or  four  words.  For  the  simple  recall  conditions,  it  is  apparent  that  the  slope  of  the 
piqiillary  function  is  greater  for  the  more  difBoult  word  strirgs  than  for  the  easier 
digit  strings.  That  these  piqilllary  response  functions  are  sensitive  to  processing  pa- 
rameters is  evident  from  the  large  dllatloos  observed  under  the  condition  labelled 
"transfonaation, " in  which  the  subject  was  required  to  respond  to  the  string  of  4 di- 
gits with  another  string  obtained  by  adding  1 to  each  digit  the  iqput  string.  This 
transformation  task  is  the  most  dilBonlt  of  all  memory  tasks  studied,  as  indicated  by 
the  error  data,  and  it  consistently  was  accompanied  by  larger  piqiillary  movements 
indicating  CNS  activation. 

Behavioral  data  sqpporting  the  oontantion  that  the  demands  iq>on  limited  infor- 
mation-processing capacity  increase  during  the  rising  jdiase  of  the  pupillary  re- 
sponse function  as  items  are  entered  into  working  memory  and  decrease  during  the 
falling  phase  of  that  function  as  items  are  successively  recalled  from  memory,  is 
provided  by  an  experiment  in  which  residual  capacity  was  measured  using  secondary- 
task  measurement.  Kahneman,  Beatty,  and  Pollack  (reference  19)  reported  that  the 
pattern  of  Interference  with  a secondary  perceptual-detection  task  exactly  paralleled 
the  piq>lllary-actlvation  curve  obtained  for  the  serial  memory  transformati<ni  task 
alone.  For  serial  memory  tasks,  changes  in  cognitive  workload  appear  to  be  reflec- 
ted in  the  momentary  level  of  CNS  activation,  as  Indexed  by  pupillometric  measure- 
ment. 


COMPLEX  PROBLEM  SOLVING 


Pupillary  dilations  accompnayiag  oomfdax  problem  solving  appear  to  be  related 
directly  to  tiie  difBcully  of  such  prooasalng,  although  behavioral  assessments  of 
workload  have  not  yet  appeared  for  these  types  of  cognitive  tasks.  For  exampls,  Hess 
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Figure  2.  Upper  graph:  Arerage  pqptUary  diameter  during  presentation  and  recall  of 
stiiaga  of  S to  7 digits,  sspaximposed  about  the  two  second  pause  between 
prsssBtatloB  and  reoall.  Slaabss  indioate  Oe  beginning  and  the  end  of  the 
memory  task.  Lower  gr^iht  Pupillary  diameter  during  presentation  and 
reoall  of  four  digits,  woi^  and  a digit  transformation  task.  (From  Kahne- 
man  b Beatty,  1866) 


and  Polt  (8)  examined  p\q)lllary  movements  as  multiplication  problems  were  solved 
mentally.  Pupillary  diameter  increased  during  the  period  preceding  solution,  and  the 
magnitude  of  dilation  was  related  to  presumed  problem  difficulty.  Payne,  Parry,  and 
Haras}rmlw  (reference  20)  also  report  a monotonlc  relation  between  mean  pupillary 
diameter  and  problem  difficulty,  but  note  tlmt  this  relationship  Is  markedly  nonlinear 
with  respect  to  difficulty  scales  based  upon  percent  correct  solution,  time  to  solution 
or  subjective  rating  of  difficulty.  Piq>lllary  diameter  in  mental  multiplication  appears 
to  peak  rapidly  as  a function  of  difficulty,  with  more  difficult  problems  requiring 
more  time  until  solution  Is  reached.  This  si^gests  that  cognitive  capacity  Is  quite  ful- 
ly taxed  in  complex  mental  arithmetic  problems  so  that  the  workload  per  unit  time  re- 
mains relatively  constant  as  problem  difficulty  Is  Increased  over  moderate  levels , but 
that  the  total  time  to  solution  is  increased. 

Other  types  of  complex  problem  solving  tasks  show  similar  relationships  be- 
tween pupillary  dilation  and  problem  difficulty.  For  example,  Bradshaw  (reference 
21)  has  reported  that  larger  pupillary  dilations  accompany  the  solving  of  more  difficult 
anagrams,  and  that  these  dilations  are  maintained  until  solution  Is  reached. 


IMPLICATIONS  FOR  WORKLOAD  EVALUATION  IN  MAN/MACHINE  SYSTEMS 


Traditional  interference  and  subjective-rating  methods  of  workload  evaluation 
have  been  employed  in  the  design  of  complex  man/xnachlne  interfaces,  but  neither  is 
without  its  own  particular  limitations.  Piq>lllometric  methods  of  workload  estimation 
provide  a third  alternative  that  In  certain  situations  might  be  preferable  to  either  of 
the  more  traditional  measurements. 

One  problem  for  which  pupillometric  assessment  procedures  appear  to  be  well- 
suited  Is  that  ot  display  evaluation.  Piqilllometric  methods  permit  reliable  measure- 
ment of  the  small  cognitive  workloads  associated  with  the  processing  of  sensory  infor> 
mation  that  may  not  be  detectable  by  Interference  methods.  One  project  imderway  in 
our  laboratories  examines  the  effects  of  display  readability  on  the  pupillary  dilations 
accompanying  information  acquisition.  A second  experiment  is  concerned  with  pupil- 
lometrically  measuring  cognitive  workload  Involved  in  processing  computer-generated 
speech  at  various  levels  of  intelligibility. 

The  most  Intriguing  possibility  is  that  the  measurement  of  central  nervous  sys- 
tem activation  associated  with  cognitive  function  might  provide  a common  metric  for 
the  comparison  of  workload  in  tasks  that  differ  substantially  in  their  functional  char- 
acteristics. Underlying  this  posslbili^  is  the  idea  that  CNS  activation  Is  the  limited 
general  resource  that  is  allotted  among  cognitive  processes  demanding  capacity.  If 
this  is  the  case,  then  it  may  be  possible  to  directly  compare  perceptual,  memory. 
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symbol  manipulation  and  response  processes  In  terms  of  activation  requirements.  At 
present,  however,  we  may  only  conclude  that  the  pupillometrlc  measures  of  activation 
are  useful  in  measuring  cognitive  load  for  a range  of  cognitive  processes.  No  evi- 
dence concerning  the  comparability  of  measurements  made  across  diverse  processes 
has  yet  appeared. 
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